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We study first-order quantum phase transitions in mean-field spin glasses. We solve the quantum random 
energy model using elementary methods and show that at the transition the eigenstate suddenly projects onto 
the unperturbed ground state and that the gap between the lowest states is exponentially small in the system 
size. We argue that this is a generic feature of all "random first-order" models, which includes benchmarks 
such as random satisfiability. We introduce a two-time instanton to calculate this gap in general, and discuss the 
consequences for quantum annealing. 

PACS numbers: 75.10.Nr, 03.67.Ac, 64.70.Tg, 75.50.Lk 



Solving hard combinatorial problems by temperature an- 
nealing is a classic strategy in computer science A major 
question is whether annealing a quantum mechanical kinetic 
term J2, 0] or a transverse magnetic field Y can be an effi- 
cient strategy. Experimentally this question was studied in an 
Ising spin glass (SG) 01; an archetype for difficult systems 
in physics. A quantum first-order transition was observed at 
very low temperatures, as had been previously found in model 
systems |5|,|g]. Here we address several open questions: What 
is the underlying behavior of the wave functions at the quan- 
tum spin glass transition? Is quantum annealing efficient in 
solving these difficult optimization problems? We thus first 
solve a simple quantum version of a spin glass model, the ran- 
dom energy model (REM) 0]. Despite its simplicity, it re- 
produces many properties of mean-field field glasses J3l and 
allows one to model the behavior of a wide variety of phenom- 
ena such as the "ideal" glass transition (8|] and random het- 
eropolymer folding jjj. The REM also captures aspects of the 
phenomenology of random satisfiability 1 1011 and is closely re- 
lated to the random code ensemble in coding theory III ill . All 
these problems belong to the so-called "random first-order" 
(RFO), or "one-step replica symmetry breaking" class. To 
show that in all of these systems the minimal spectral gap A 
between the ground and first excited states is exponentially 
small in the size, we set up an instanton calculation that al- 
lows one to compute the gap. The minimal spectral gap in 
turn yields a lower bound r oc A -2 J2l on the time needed to 
find the ground state. 

Quantum spin glasses have been investigated over the 
past 30 years ll 2ll using an elaborate mathematical formal- 
ism combining the replica 1 1311 and the Suzuki-Trotter meth- 
ods 03] in order to introduce disorder and quantum me- 
chanics. The quantum transition has been found to be first 
order at low temperature for all RFO models JH H 03] ■ We 
show here first that the quantum version of the random en- 
ergy model (QREM) can be solved analytically using only ba- 
sic tools of perturbation theory, a derivation whose simplicity 
provides a detailed understanding of the quantum glass transi- 
tion. The minimal gap A is found to be exponentially small in 
7Y. Next, we show that this result holds for all RFO models, 
making quantum annealing an exponentially slow algorithm 



in those cases. 

QREM Model. — Consider N Pauli spins a in a transverse 
field r with the Hamiltonian: 

N 

u{{cr}) = £(K» + = «„ + rv, 



where E({a z }) is a function that takes 2^ different values for 
the 2 N configurations of the N spins. These values are taken 
randomly from a Gaussian distribution of zero mean and vari- 
ance N/2, as in the REM J3]. A concrete implementation is 

E({a z }) = limp^oo Efe,...,*, J h,-,i P < ' ' ' where the 
Ji x i are random Gaussian variables. In the a z represen- 



tation H is a 2 x 2 matrix whose diagonal entries are the 
2 N classical energies. The matrix elements of Hq a = E^; EM 
and Hq ^ = 0, while V a /3 = 1 if a and (3 are two configura- 
tions that differ by a single spin flip and zero otherwise. Ji is 
sparse and can be studied numerically rather efficiently even 
for large matrix sizes using Arnoldi and Ritz methods IU5I1 

Two easy limits. — The model is trivially solved in the limit 
r — > and r — > oo. For T = 0, we recover the classical REM 
with N Ising spins and 2 N configurations, each correspond- 
ing to an energy level E a J3]: Call n(E) the number of en- 
ergy levels belonging to the interval (E, E + dE); its average 
over all realizations is easily computed: n(E) = 2 N P(E) oc 



3 JV(ln2-£; 2 /iV 2 ) _ Ns(E/N) 



where s(e) = ln2 — e 2 (with 



e = E/N). There is therefore a critical energy density 
eo = — Vln2 such that, if e < en, then with high probability 
there are no configurations while if e > eo the entropy den- 
sity is finite. A transition between these two regimes arises 
at tjt = ds j^ | eo = 2v / ln2 and the thermodynamic behavior 

follows: (i) For T < T c , /rem = — \Ari2 and the system 
is frozen in its lowest energy states. Only a finite number of 
levels (and only the ground state at T = 0) contribute to the 
partition sum. The energy gap between them is finite, (ii) For 
T > T c , /rem = — -pf — Tln2; exponentially many configu- 
rations contribute to the partition sum. 

In the opposite case of very large values of V, the REM 
contribution to the energy can be neglected. In the a x ba- 
sis, we find independent classical spins in a field T; the 
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entropy density is just given by the log of a binomial distribu- 
tion between — FN and +TN and the free-energy density is 
/para = -Tln2 - T ln(coshr/T). 

Perturbation theory.— -What happens between these two ex- 
treme cases? The perhaps surprising answer for the thermody- 
namics is nothing. At low value of T, the free-energy density 
is that of the classical REM, while for larger values it jumps 
to the quantum paramagnetic (QP) value /qp; a first-order 
transition separates the two different behaviors at the value T 
such that /rem = /qp (see center panel of Fig. |T}. This can 
be easily understood using Ray leigh-Schrodinger perturbation 
theory Il6l[r7ll . Consider the set of eigenvalues E). and eigen- 
vectors \k) of the unperturbed REM, when T = 0. The series 
for a given perturbed eigenvalue Ei(T) reads 



E i (T)=E i + (i\J2TV 



E l -H 

where the projector Q — J2k^i I^X^I so tnat 

Ei — Eu 



(Ei-Ei(T)+TV) 



E l (T) = E l + rV u +Y, 



(1) 



k^i 



Since ^ if and only if i and j are two configurations that 
differ by a single spin flip, odd order terms do not contribute in 
Eq. ([T} as one requires an even number of flips to come back to 
the initial configuration in the sums. Noting that J2k^n l^nfc | 2 
reduces to a sum over the N levels connected to Ei by a single 
spin flip, one obtains, starting from an extensive eigenvalue 
[Ei = O(N)], that 



E 

k^i 



Ei - E k 



E, ^ I Ei 
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N ( 1 



where we have used that the E^ are random and typically of 
order y/N. Higher nth orders are computed in the same spirit 
and are found to be 0{N n / 2 ~ 1 ). Therefore, to all (finite) or- 
ders, we have 



E % {T) = Ei 



NT 2 
~E~ 



O 



(2) 



This analytic result compares well with a numerical evaluation 
of the eigenvalues (left panel of Fig. Q]). Note that the energy 
density of all extensive levels is independent of T to leading 
order in N as are hence s(e) and /(T). 

The expansion can also be performed using TV as a starting 
point and Ho as a perturbation. Consider the ground state 
with eigenvalue Eq (r) and the unperturbed ground state with 
Eq (r) = — TN. In the base corresponding to the eigenvalues 
of TV, we find 



E Q (r) = E o / (r) + (0\Ho\0)+Y, 



\(k\Ho 



k^O 



EV{T)-E v k {T) 



The first-order term gives J2a=i ^a EM \ v a\' 2 - Since the en- 
ergies of the REM are random and uncorrected with v a this 



sums to 0(y/N2 N / 2 ). For the second-order term, one finds 



E 

k^O 



l(fc|H |0)| 2 
E^(T)-EX(T) 

(0 | Hi | 0) 



K* I Wo I o)| 



^(T)/<(T) 



N 



2EX(T) 



o(l). 



(3) 



Subsequent terms are treated similarly and give vanishing 
corrections so that E (T) = —NT — ^ + o(l). Again 
this derivation holds for other states with extensive energies 
EY(T), the only tricky point being the degeneracy of the 
eigenvalues [18.], and for these excited eigenstates, the per- 
turbation starting from the large V phase yields Ei(T) — 
EY (r) — ^yr + o(l). Again, to leading order in N, energy, 
entropy and free-energy densities are not modified by the per- 
turbation. 

The quantum transition. — This derivation sheds new light 
on the physics of the transition: The wave function in the QP 
phase is delocalized over the classical configurations in the 
a z base. The first-order transition amounts to a sudden lo- 
calization of the wave function into an exponential number of 
classical states for T > T c and a finite number of frozen states 
for T <T C (and to the ground state at T = 0). 

Focusing on T = and on the avoided level crossing near 
the transition, we compute the gap A(N) as follows: Consider 
a value of T such that for that sample the SG ground state and 
the quantum paramagnet are degenerate. We lift the degener- 
acy by diagonalizing H in the corresponding two-dimensional 
space 

H\4>) = [E () \SG)(SG\-rN\QP)(QP\}\<f ) ) = \\<f>). 

The gap is given by the difference of the eigenvalues, so that 

A(N,r) 2 = (NT-Eq) 2 -4[-E Q NT + E NT(SG\QP) 2 ] 

and at the transition when T = — Vln2 = Eq/N, it yields 

A min (iV) =2\E \2~ N / 2 , (4) 

where we have used the fact that (SG\QP) = 2~ Ar / 2 . This 
agrees well with numerics, even for small values of TV (see 
left panel of Fig. [U. Similar results are known for number 
partitioning IU9I1 . 

Generic case and Instanton. — A first-order quantum tran- 
sition being a generic feature in all RFO models, we expect 
these arguments to hold qualitatively in all such models, so 
that the gap closes exponentially with N, much in the same 
way that a thermal mean-field first-order transition implies an 
exponential activation time and metastability. Indeed, quan- 
tum annealing works by tunneling between quantum states, 
but in first-order transitions these states are usually "far" from 
each other. In order to quantitatively compute the gap, per- 
turbation theory is of no use in the generic case and one has 
to resort to instantonic computations I20I1 . We now discuss 
how this can be done in disordered systems using the replica 
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FIG. 1 : (color online). Left: Evolution of lowest energy levels for a single realization of the QREM with N = 20 spins (dots) compared with 
analytical predictions (lines). Inset: Evolution of the ensemble averaged minimal gap at the transition. Center: Phase diagram of the QREM 
in temperatu re T and transverse field r. At T = the quantum transition arises at T c = Vln2 while the classical glass transition for T = 
is at T c = Vln2/2. Right: A multi-instanton configuration for the two-times overlap q tv and the two-time Lagrange multipliers q t ,f- Far 
from the jump times, the functions q tt i and q tt i take the same form as those computed at those times for the glass phase [the regions (1,1)], 
for the quantum paramagnet (in the regions (2,2)), and are zero in the mixed regions (1,2)-(2,1). In the large p limit the problem can be solved 
completely using the so-called "static approximation" 13, [l4ll within the (1,1) regions, and, in addition, the fact that qf t , and q tt i become 
either infinity or zero, with sharp interfaces. 



method. To introduce the instanton, we use the expansion of 
the evolution operator and, denoting e = (QP\H\SG), write 



Tr e 



-PH 



k even 



dti . . . dt^e 



(5) 

where the system jumps at tj., ...,£& between the states \SG) 
and \QP), ff^ and t^ t is the total time spent in each. Fol- 
lowing the standard strategy J5[ S [HL the trace is com- 
puted via the Suzuki-Trotter and the replica trick. One ob- 
tains an effective replicated free energy as a function of the 
overlaps q? between the replicas at two (imaginary) times 
and some corresponding Lagrange multipliers q^",, for which 



a particular ansatz must be proposed |5l |6[|. Equation <j3j 
tells us that if we find a solution that interpolates between 
\SG) and \QP) by jumping k times ti,...,tk and yields 
lnTr[e-P H ] ~ ~& SG - i t Q ^ QP - kG, then by simple 
comparison lne ~ G leads to A ~ e G : An extensive value 
of G implies an exponentially small gap and the value of G is 
thus proportional to the free-energy cost of an interface in a 
two-time plane. For disordered systems, the computation can 
be performed by using a special two-time instanton ansatz as 
shown in the right panel of Fig [T] We now refer to the presen- 
tation and notation of IU4I1 . We calculate the free energy per 
spin / = F/N of the replicated systems in the N — ► oo limit 
by the saddle point method. In the one-step replica symmetry 
ansatz, we divide replicas [i in n/m sets of size m: we denote 
the parameters q^", as (i) qf t , if /i = v 112 ill , (ii) qw if [4 v 
but belong to the same block and zero otherwise. This corre- 
sponds to the SG and the QP that have been widely studied 



fi&Q 



dt dt' 

[3 2 J 2 



(3 2 J 2 



(l-m)& + 



(l-m) 3 



-qwqtt' 



d ip 



K> 



-w . 



(6) 



An expression for Wq is given below. We consider a solu- 
tion corresponding to the low-r phase in the interval (0, t\), 
{t2,t%) that jumps to the high-T phase in the intervals (ti, ia)> 
(ti, t$), and so on. 

As a proof of principle, let us rederive the large-p case. 
The saddle point equations imply that for large p either 

(qw , q? t > , qw , qft' ) = (1, 1, oo, oo) or (qw , q w , qw , q w ) = 
(< 1, < 1, 0, 0). This implies that the form of the instanton 
configuration of qf t , and qu> is the same as the one of qw and 
qf t , but with the values jumping from to oo. In addition 
we make the "static approximation " that assumes that inside 
each time interval the parameters q d and q d are constant. We 
conclude that we can write 



2$f 



qt'f 



„d„d 



qt'f 



nr t > 



(7) 



where r t and rf are large in the time intervals when the system 
is in the SG state, and drop to zero when it is not. (The solu- 
tions in the literature correspond to a time-independent value 
of r: large for the glass and small for the QP phase, respec- 
tively). Because qfi t i, qt'f are either zero or one, we have 



dt dt' q tt ,qw - J dtdt'q w = I 2 
2 / dt dt 1 q d tt ,q d tt , =2 [dt dt' q d t , - I 2 + I 2 (8) 
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with the definitions I = J dt r(t) and I d = J dt r d (t). We 
further decouple the replicas in the single-spin term in the 
usual way 

Wo=lnTrexp(-H e ff) 

= -L\ n ^J Dz2 ~ J Dz ^(T e Sdt'{A{t')«*+0T^ m | ; 

(9) 

where T denotes time order (a necessity here because of the 
time dependence in the exponent), and A(t) = (z^rf + z^rt)- 
At low temperatures, the "field" in the x direction f3T is 
strong, while the field in the z direction \ A(i) \ is either zero or 
\A(t)\ >> /3T. The single quantum spin then switches from 
being completely polarized along \z) and along \x), in the pe- 
riods in which i ^ and A = 0, respectively. The trace in (0 
can then be calculated by switching the single-spin basis from 
\x) to \z). Denoting t SG = 0/3 the time when q t = qf = 1, 
and fQ p = (1 — 0)3 the rest, the action becomes 



/3 2 J 2 



(1 - m) + 



/? 2 J 2 



-i/ 2 - 



4 \ 4 j 2 a 2 

+ (1 — 9)/?r + (number of jumps) x In |(a;|z)|, 
where the terms come from a change of basis, and 



— log 

m 



Dz 2 



Dz 3 e 



\zil+z?,I d \ 



This can be evaluated by the saddle point [3, a short cal- 



culation yields W z 



in 

2 ±J 



m t2 



ln2. Taking a further 



saddle point with respect to m gives m = and thus 



-BJ 



-f3f = 9Vln2^- + (1 - Q)f3T + k In | 



(10) 



This is exactly the contribution to Tr[e _ ^ H ] of the process 
with k jumps spending a fraction in the glass state and 
(1 — G) in the paramagnetic state. We finally have G = 
N\n\(x\z}\ — — iVln(2)/2 and we recover the result of 
Eq. ©. 

In a generic problem with a first-order transition, one has to 
extremize the free energy (O and from there compute the gap 
as a free-energy cost of an interface that is generally nonzero. 

Conclusion. — Starting from the quantum random energy 
model, we have discussed the quantum glass transition. The 
gap is exponentially small at the transition. We introduce a 
method that allows us to show that this result holds for all 
models of the random first-order kind; presumably including 
benchmark problems such as random satisfiability. Our results 
imply that quantum annealing is exponentially slow at finding 
the ground state of these random NP-hard (nondeterministic- 
polynomial-time-hard) problems. Although this seems to con- 
tradict recent numerical results |22J], the problems considered 



there were not randomly chosen from a flat distribution and 
are therefore different from what has been considered in the 
present study and in the computer science literature of random 
constraint satisfaction problems. 
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